Validity, reliability, and responsiveness of daily monitoring visual analog scales in MASK‐air®

Background: MASK-air® is an app that supports allergic rhinitis patients in disease control. Users register daily allergy symptoms and their impact on activities using visual analog scales (VASs). We aimed to assess the concurrent validity, reliability, and responsiveness of these daily VASs. Methods: Daily monitoring VAS data were assessed in MASK-air® users with allergic rhinitis. Concurrent validity was assessed by correlating daily VAS values with those of the EuroQol-5 Dimensions (EQ-5D) VAS, the Control of Allergic Rhinitis and Asthma Test (CARAT) score, and the Work Productivity and Activity Impairment Allergic Specific (WPAI-AS) Questionnaire (work and activity impairment scores). Intra-rater reliability was assessed in users providing multiple daily VASs within the same day. Test–retest reliability was tested in clinically stable users, as defined by the EQ-5D VAS, CARAT, or “VAS Work” (i.e., VAS assessing the impact of allergy on work). Responsiveness was determined in users with two consecutive measurements of EQ-5D-VAS or “VAS Work” indicating clinical change. Results: A total of 17,780 MASK-air® users, with 317,176 VAS days, were assessed. Concurrent validity was moderate–high (Spearman correlation coefficient range: 0.437–0.716). Intra-rater reliability intraclass correlation coefficients (ICCs) ranged between 0.870 (VAS assessing global allergy symptoms) and 0.937 (VAS assessing allergy symptoms on sleep). Test–retest reliability ICCs ranged between 0.604 and 0.878—“VAS Work” and “VAS asthma” presented the highest ICCs. Moderate/large responsiveness effect sizes were observed—the sleep VAS was associated with lower responsiveness, while the global allergy symptoms VAS demonstrated higher responsiveness. Conclusion: In MASK-air®, daily monitoring VASs have high intra-rater reliability and moderate–high validity, reliability, and responsiveness, pointing to a reliable measure of symptom loads

Behavioural patterns in allergic rhinitis medication in Europe : A study using MASK-air(R) real-world data

Background Co-medication is common among patients with allergic rhinitis (AR), but its dimension and patterns are unknown. This is particularly relevant since AR is understood differently across European countries, as reflected by rhinitis-related search patterns in Google Trends. This study aims to assess AR co-medication and its regional patterns in Europe, using real-world data. Methods We analysed 2015-2020 MASK-air(R) European data. We compared days under no medication, monotherapy and co-medication using the visual analogue scale (VAS) levels for overall allergic symptoms ('VAS Global Symptoms') and impact of AR on work. We assessed the monthly use of different medication schemes, performing separate analyses by region (defined geographically or by Google Trends patterns). We estimated the average number of different drugs reported per patient within 1 year. Results We analysed 222,024 days (13,122 users), including 63,887 days (28.8%) under monotherapy and 38,315 (17.3%) under co-medication. The median 'VAS Global Symptoms' was 7 for no medication days, 14 for monotherapy and 21 for co-medication (p < .001). Medication use peaked during the spring, with similar patterns across different European regions (defined geographically or by Google Trends). Oral H-1-antihistamines were the most common medication in single and co-medication. Each patient reported using an annual average of 2.7 drugs, with 80% reporting two or more. Conclusions Allergic rhinitis medication patterns are similar across European regions. One third of treatment days involved co-medication. These findings suggest that patients treat themselves according to their symptoms (irrespective of how they understand AR) and that co-medication use is driven by symptom severity.Peer reviewe

Development and validation of combined symptom-medication scores for allergic rhinitis*

Background Validated combined symptom-medication scores (CSMSs) are needed to investigate the effects of allergic rhinitis treatments. This study aimed to use real-life data from the MASK-air(R) app to generate and validate hypothesis- and data-driven CSMSs. Methods We used MASK-air(R) data to assess the concurrent validity, test-retest reliability and responsiveness of one hypothesis-driven CSMS (modified CSMS: mCSMS), one mixed hypothesis- and data-driven score (mixed score), and several data-driven CSMSs. The latter were generated with MASK-air(R) data following cluster analysis and regression models or factor analysis. These CSMSs were compared with scales measuring (i) the impact of rhinitis on work productivity (visual analogue scale [VAS] of work of MASK-air(R), and Work Productivity and Activity Impairment: Allergy Specific [WPAI-AS]), (ii) quality-of-life (EQ-5D VAS) and (iii) control of allergic diseases (Control of Allergic Rhinitis and Asthma Test [CARAT]). Results We assessed 317,176 days of MASK-air(R) use from 17,780 users aged 16-90 years, in 25 countries. The mCSMS and the factor analyses-based CSMSs displayed poorer validity and responsiveness compared to the remaining CSMSs. The latter displayed moderate-to-strong correlations with the tested comparators, high test-retest reliability and moderate-to-large responsiveness. Among data-driven CSMSs, a better performance was observed for cluster analyses-based CSMSs. High accuracy (capacity of discriminating different levels of rhinitis control) was observed for the latter (AUC-ROC = 0.904) and for the mixed CSMS (AUC-ROC = 0.820). Conclusion The mixed CSMS and the cluster-based CSMSs presented medium-high validity, reliability and accuracy, rendering them as candidates for primary endpoints in future rhinitis trials.Peer reviewe

Development and validation of combined symptom‐medication scores for allergic rhinitis*

Background: Validated combined symptom-medication scores (CSMSs) are needed to investigate the effects of allergic rhinitis treatments. This study aimed to use real-life data from the MASK-air® app to generate and validate hypothesis- and data-driven CSMSs. Methods: We used MASK-air® data to assess the concurrent validity, test-retest reliability and responsiveness of one hypothesis-driven CSMS (modified CSMS: mCSMS), one mixed hypothesis- and data-driven score (mixed score), and several data-driven CSMSs. The latter were generated with MASK-air® data following cluster analysis and regression models or factor analysis. These CSMSs were compared with scales measuring (i) the impact of rhinitis on work productivity (visual analogue scale [VAS] of work of MASK-air® , and Work Productivity and Activity Impairment: Allergy Specific [WPAI-AS]), (ii) quality-of-life (EQ-5D VAS) and (iii) control of allergic diseases (Control of Allergic Rhinitis and Asthma Test [CARAT]). Results: We assessed 317,176 days of MASK-air® use from 17,780 users aged 16-90 years, in 25 countries. The mCSMS and the factor analyses-based CSMSs displayed poorer validity and responsiveness compared to the remaining CSMSs. The latter displayed moderate-to-strong correlations with the tested comparators, high test-retest reliability and moderate-to-large responsiveness. Among data-driven CSMSs, a better performance was observed for cluster analyses-based CSMSs. High accuracy (capacity of discriminating different levels of rhinitis control) was observed for the latter (AUC-ROC = 0.904) and for the mixed CSMS (AUC-ROC = 0.820). Conclusion: The mixed CSMS and the cluster-based CSMSs presented medium-high validity, reliability and accuracy, rendering them as candidates for primary endpoints in future rhinitis trials

Allergen immunotherapy in MASK-air users in real-life : Results of a Bayesian mixed-effects model

Background Evidence regarding the effectiveness of allergen immunotherapy (AIT) on allergic rhinitis has been provided mostly by randomised controlled trials, with little data from real-life studies. Objective To compare the reported control of allergic rhinitis symptoms in three groups of users of the MASK-air(R) app: those receiving sublingual AIT (SLIT), those receiving subcutaneous AIT (SCIT), and those receiving no AIT. Methods We assessed the MASK-air(R) data of European users with self-reported grass pollen allergy, comparing the data reported by patients receiving SLIT, SCIT and no AIT. Outcome variables included the daily impact of allergy symptoms globally and on work (measured by visual analogue scales-VASs), and a combined symptom-medication score (CSMS). We applied Bayesian mixed-effects models, with clustering by patient, country and pollen season. Results We analysed a total of 42,756 days from 1,093 grass allergy patients, including 18,479 days of users under AIT. Compared to no AIT, SCIT was associated with similar VAS levels and CSMS. Compared to no AIT, SLIT-tablet was associated with lower values of VAS global allergy symptoms (average difference = 7.5 units out of 100; 95% credible interval [95%CrI] = -12.1;-2.8), lower VAS Work (average difference = 5.0; 95%CrI = -8.5;-1.5), and a lower CSMS (average difference = 3.7; 95%CrI = -9.3;2.2). When compared to SCIT, SLIT-tablet was associated with lower VAS global allergy symptoms (average difference = 10.2; 95%CrI = -17.2;-2.8), lower VAS Work (average difference = 7.8; 95%CrI = -15.1;0.2), and a lower CSMS (average difference = 9.3; 95%CrI = -18.5;0.2). Conclusion In patients with grass pollen allergy, SLIT-tablet, when compared to no AIT and to SCIT, is associated with lower reported symptom severity. Future longitudinal studies following internationally-harmonised standards for performing and reporting real-world data in AIT are needed to better understand its 'real-world' effectiveness.Peer reviewe

Consistent trajectories of rhinitis control and treatment in 16,177 weeks : The MASK-air (R) longitudinal study

Introduction: Data from mHealth apps can provide valuable information on rhinitis control and treatment patterns. However, in MASK-air (R), these data have only been analyzed cross-sectionally, without considering the changes of symptoms over time. We analyzed data from MASK-air (R) longitudinally, clustering weeks according to reported rhinitis symptoms.Methods: We analyzed MASK-air (R) data, assessing the weeks for which patients had answered a rhinitis daily questionnaire on all 7days. We firstly used k-means clustering algorithms for longitudinal data to define clusters of weeks according to the trajectories of reported daily rhinitis symptoms. Clustering was applied separately for weeks when medication was reported or not. We compared obtained clusters on symptoms and rhinitis medication patterns. We then used the latent class mixture model to assess the robustness of results.Results: We analyzed 113,239 days (16,177 complete weeks) from 2590 patients (mean age +/- SD = 39.1 +/- 13.7 years). The first clustering algorithm identified ten clusters among weeks with medication use: seven with low variability in rhinitis control during the week and three with highly-variable control. Clusters with poorly-controlled rhinitis displayed a higher frequency of rhinitis co-medication, a more frequent change of medication schemes and more pronounced seasonal patterns. Six clusters were identified in weeks when no rhinitis medication was used, displaying similar control patterns. The second clustering method provided similar results. Moreover, patients displayed consistent levels of rhinitis control, reporting several weeks with similar levels of control.Conclusions: We identified 16 patterns of weekly rhinitis control. Co-medication and medication change schemes were common in uncontrolled weeks, reinforcing the hypothesis that patients treat themselves according to their symptoms.[GRAPHICS].Peer reviewe

Patient‐centered digital biomarkers for allergic respiratory diseases and asthma: The ARIA‐EAACI approach – ARIA‐EAACI Task Force Report

Biomarkers for the diagnosis, treatment and follow-up of patients with rhinitis and/ or asthma are urgently needed. Although some biologic biomarkers exist in specialist care for asthma, they cannot be largely used in primary care. There are no validated biomarkers in rhinitis or allergen immunotherapy (AIT) that can be used in clinical practice. The digital transformation of health and health care (including mHealth) places the patient at the center of the health system and is likely to optimize the practice of allergy. Allergic Rhinitis and its Impact on Asthma (ARIA) and EAACI (European Academy of Allergy and Clinical Immunology) developed a Task Force aimed at proposing patient-reported outcome measures (PROMs) as digital biomarkers that can be easily used for different purposes in rhinitis and asthma. It first defined control digital biomarkers that should make a bridge between clinical practice, randomized controlled trials, observational real-life studies and allergen challenges. Using the MASK-air app as a model, a daily electronic combined symptom-medication score for allergic diseases (CSMS) or for asthma (e-DASTHMA), combined with a monthly control questionnaire, was embedded in a strategy similar to the diabetes approach for disease control. To mimic real-life, it secondly proposed quality-of- life digital biomarkers including daily EQ-5D visual analogue scales and the bi-weekly RhinAsthma Patient Perspective (RAAP). The potential implications for the management of allergic respiratory diseases were proposed.info:eu-repo/semantics/publishedVersio

Real-world data using mHealth apps in rhinitis, rhinosinusitis and their multimorbidities

Digital health is an umbrella term which encompasses eHealth and benefits from areas such as advanced computer sciences. eHealth includes mHealth apps, which offer the potential to redesign aspects of healthcare delivery. The capacity of apps to collect large amounts of longitudinal, real-time, real-world data enables the progression of biomedical knowledge. Apps for rhinitis and rhinosinusitis were searched for in the Google Play and Apple App stores, via an automatic market research tool recently developed using JavaScript. Over 1500 apps for allergic rhinitis and rhinosinusitis were identified, some dealing with multimorbidity. However, only six apps for rhinitis (AirRater, AllergyMonitor, AllerSearch, Husteblume, MASK-air and Pollen App) and one for rhinosinusitis (Galenus Health) have so far published results in the scientific literature. These apps were reviewed for their validation, discovery of novel allergy phenotypes, optimisation of identifying the pollen season, novel approaches in diagnosis and management (pharmacotherapy and allergen immunotherapy) as well as adherence to treatment. Published evidence demonstrates the potential of mobile health apps to advance in the characterisation, diagnosis and management of rhinitis and rhinosinusitis patients.Peer reviewe

The ARIA-MASK-air® approach

Funding Information: The authors thank Ms Véronique Pretschner for submitting the paper. MASK‐air has been supported by Charité Universitätsmedizin Berlin, EU grants (EU Structural and Development Funds Languedoc Roussillon and Region PACA; POLLAR: EIT Health; Twinning: EIP on AHA; Twinning DHE: H2020; Catalyse: Horizon Europe) and educational grants from Mylan‐Viatris, ALK, GSK, Novartis, Stallergènes‐Greer and Uriach. None for the study. ® Publisher Copyright: © 2023 The Authors. Clinical and Translational Allergy published by John Wiley & Sons Ltd on behalf of European Academy of Allergy and Clinical Immunology.MASK-air®, a validated mHealth app (Medical Device regulation Class IIa) has enabled large observational implementation studies in over 58,000 people with allergic rhinitis and/or asthma. It can help to address unmet patient needs in rhinitis and asthma care. MASK-air® is a Good Practice of DG Santé on digitally-enabled, patient-centred care. It is also a candidate Good Practice of OECD (Organisation for Economic Co-operation and Development). MASK-air® data has enabled novel phenotype discovery and characterisation, as well as novel insights into the management of allergic rhinitis. MASK-air® data show that most rhinitis patients (i) are not adherent and do not follow guidelines, (ii) use as-needed treatment, (iii) do not take medication when they are well, (iv) increase their treatment based on symptoms and (v) do not use the recommended treatment. The data also show that control (symptoms, work productivity, educational performance) is not always improved by medications. A combined symptom-medication score (ARIA-EAACI-CSMS) has been validated for clinical practice and trials. The implications of the novel MASK-air® results should lead to change management in rhinitis and asthma.publishersversionpublishe

ARIA digital anamorphosis : Digital transformation of health and care in airway diseases from research to practice

Digital anamorphosis is used to define a distorted image of health and care that may be viewed correctly using digital tools and strategies. MASK digital anamorphosis represents the process used by MASK to develop the digital transformation of health and care in rhinitis. It strengthens the ARIA change management strategy in the prevention and management of airway disease. The MASK strategy is based on validated digital tools. Using the MASK digital tool and the CARAT online enhanced clinical framework, solutions for practical steps of digital enhancement of care are proposed.Peer reviewe